2025-04-03 16:57:07,289 [ 584284 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse (runner:53, check_args_and_update_paths) 2025-04-03 16:57:07,289 [ 584284 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:97, check_args_and_update_paths) 2025-04-03 16:57:07,289 [ 584284 ] INFO : utils dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/utils (runner:108, check_args_and_update_paths) 2025-04-03 16:57:07,289 [ 584284 ] INFO : base_configs_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:110, check_args_and_update_paths) clickhouse_integration_tests_volume Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_8u4b23 --privileged --dns-search='.' --memory=30709026816 --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=5dc43a6382f0 -e DOCKER_BASE_TAG=6712d5cc610d -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS=" -rfEps --run-id=2 --color=no --durations=0 test_reload_certificate/test.py::test_chain_reload -vvv" altinityinfra/integration-tests-runner:cd6390247eca '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3 cachedir: .pytest_cache rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: random-0.2, timeout-2.2.0, repeat-0.9.3, order-1.0.0, reportlog-0.4.0, xdist-3.5.0 timeout: 900.0s timeout method: signal timeout func_only: False collecting ... collected 1 item test_reload_certificate/test.py::test_chain_reload FAILED [100%] =================================== FAILURES =================================== ______________________________ test_chain_reload _______________________________ def test_chain_reload(): """Check cert chain reload""" > check_certificate_switch("first", "WithChain") test_reload_certificate/test.py:169: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ test_reload_certificate/test.py:118: in check_certificate_switch assert ( helpers/cluster.py:4142: in exec_in_container return self.cluster.exec_in_container( helpers/cluster.py:2134: in exec_in_container result = subprocess_check_call( helpers/cluster.py:244: in subprocess_check_call return run_and_check(args, detach=detach, nothrow=nothrow) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker', 'exec', 'roottestreloadcertificate-node-1', 'curl', '--silent', '--cacert', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args: Union[Sequence[str], str], env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ) -> str: if shell: if isinstance(args, str): shell_args = args else: shell_args = next(a for a in args) else: shell_args = " ".join(args) logging.debug("Command:[%s]", shell_args) if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return "" res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout, check=False, ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug("Stdout:%s", outline) for errline in err.splitlines(): logging.debug("Stderr:%s", errline) if res.returncode != 0: logging.debug("Exitcode:%s", res.returncode) if env: logging.debug("Env:%s", env) if not nothrow: > raise Exception( f"Command [{shell_args}] return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command [docker exec roottestreloadcertificate-node-1 curl --silent --cacert /etc/clickhouse-server/config.d/WithChain.crt https://localhost:8443/] return non-zero code 60: helpers/cluster.py:154: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ------------------------------ Captured log setup ------------------------------ 2025-04-03 16:57:11 [ 630 ] DEBUG : Command:[docker ps | wc -l] (cluster.py:122, run_and_check) 2025-04-03 16:57:11 [ 630 ] DEBUG : Stdout:1 (cluster.py:146, run_and_check) 2025-04-03 16:57:11 [ 630 ] DEBUG : No running containers (conftest.py:96, cleanup_environment) 2025-04-03 16:57:11 [ 630 ] DEBUG : Pruning Docker networks (conftest.py:98, cleanup_environment) 2025-04-03 16:57:11 [ 630 ] DEBUG : Command:[docker network prune --force] (cluster.py:122, run_and_check) 2025-04-03 16:57:11 [ 630 ] DEBUG : Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] (cluster.py:122, run_and_check) 2025-04-03 16:57:11 [ 630 ] DEBUG : Stdout:net.ipv4.ip_local_port_range = 55000 65535 (cluster.py:146, run_and_check) 2025-04-03 16:57:11 [ 630 ] INFO : Running tests in /ClickHouse/tests/integration/test_reload_certificate/test.py (cluster.py:2793, start) 2025-04-03 16:57:11 [ 630 ] DEBUG : Cluster start called. is_up=False (cluster.py:2800, start) 2025-04-03 16:57:11 [ 630 ] DEBUG : Docker networks for project roottestreloadcertificate are NETWORK ID NAME DRIVER SCOPE (cluster.py:873, print_all_docker_pieces) 2025-04-03 16:57:11 [ 630 ] DEBUG : Docker containers for project roottestreloadcertificate are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:881, print_all_docker_pieces) 2025-04-03 16:57:11 [ 630 ] DEBUG : Docker volumes for project roottestreloadcertificate are DRIVER VOLUME NAME (cluster.py:889, print_all_docker_pieces) 2025-04-03 16:57:11 [ 630 ] DEBUG : Cleanup called (cluster.py:894, cleanup) 2025-04-03 16:57:11 [ 630 ] DEBUG : Docker networks for project roottestreloadcertificate are NETWORK ID NAME DRIVER SCOPE (cluster.py:873, print_all_docker_pieces) 2025-04-03 16:57:11 [ 630 ] DEBUG : Docker containers for project roottestreloadcertificate are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:881, print_all_docker_pieces) 2025-04-03 16:57:11 [ 630 ] DEBUG : Docker volumes for project roottestreloadcertificate are DRIVER VOLUME NAME (cluster.py:889, print_all_docker_pieces) 2025-04-03 16:57:11 [ 630 ] DEBUG : Command:[docker container list --all --filter name='^/roottestreloadcertificate-.*-1$' --format '{{.ID}}:{{.Names}}'] (cluster.py:122, run_and_check) 2025-04-03 16:57:11 [ 630 ] DEBUG : Unstopped containers: {} (cluster.py:908, cleanup) 2025-04-03 16:57:11 [ 630 ] DEBUG : No running containers for project: roottestreloadcertificate (cluster.py:922, cleanup) 2025-04-03 16:57:11 [ 630 ] DEBUG : Trying to prune unused networks... (cluster.py:928, cleanup) 2025-04-03 16:57:11 [ 630 ] DEBUG : Trying to prune unused images... (cluster.py:944, cleanup) 2025-04-03 16:57:11 [ 630 ] DEBUG : Command:[docker image prune -f] (cluster.py:122, run_and_check) 2025-04-03 16:57:11 [ 630 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:146, run_and_check) 2025-04-03 16:57:11 [ 630 ] DEBUG : Images pruned (cluster.py:947, cleanup) 2025-04-03 16:57:11 [ 630 ] DEBUG : Trying to prune unused volumes... (cluster.py:953, cleanup) 2025-04-03 16:57:11 [ 630 ] DEBUG : Command:[docker volume ls | wc -l] (cluster.py:122, run_and_check) 2025-04-03 16:57:11 [ 630 ] DEBUG : Stdout:1 (cluster.py:146, run_and_check) 2025-04-03 16:57:11 [ 630 ] DEBUG : Volumes pruned: 1 (cluster.py:958, cleanup) 2025-04-03 16:57:11 [ 630 ] DEBUG : Setup directory for instance: node (cluster.py:2813, start) 2025-04-03 16:57:11 [ 630 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4639, create_dir) 2025-04-03 16:57:11 [ 630 ] DEBUG : Create directory for common tests configuration (cluster.py:4644, create_dir) 2025-04-03 16:57:11 [ 630 ] DEBUG : Copy common configuration from helpers (cluster.py:4664, create_dir) 2025-04-03 16:57:11 [ 630 ] DEBUG : Generate and write macros file (cluster.py:4716, create_dir) 2025-04-03 16:57:11 [ 630 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_reload_certificate/configs/first.crt', '/ClickHouse/tests/integration/test_reload_certificate/configs/first.key', '/ClickHouse/tests/integration/test_reload_certificate/configs/second.crt', '/ClickHouse/tests/integration/test_reload_certificate/configs/second.key', '/ClickHouse/tests/integration/test_reload_certificate/configs/ECcert.crt', '/ClickHouse/tests/integration/test_reload_certificate/configs/ECcert.key', '/ClickHouse/tests/integration/test_reload_certificate/configs/WithChain.crt', '/ClickHouse/tests/integration/test_reload_certificate/configs/WithChain.key', '/ClickHouse/tests/integration/test_reload_certificate/configs/WithPassPhrase.crt', '/ClickHouse/tests/integration/test_reload_certificate/configs/WithPassPhrase.key', '/ClickHouse/tests/integration/test_reload_certificate/configs/cert.xml'] to /ClickHouse/tests/integration/test_reload_certificate/_instances-2/node/configs/config.d (cluster.py:4752, create_dir) 2025-04-03 16:57:11 [ 630 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_reload_certificate/_instances-2/node/database (cluster.py:4769, create_dir) 2025-04-03 16:57:11 [ 630 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_reload_certificate/_instances-2/node/logs (cluster.py:4780, create_dir) 2025-04-03 16:57:11 [ 630 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] (cluster.py:4864, create_dir) 2025-04-03 16:57:11 [ 630 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw'} stored in /ClickHouse/tests/integration/test_reload_certificate/_instances-2/.env (cluster.py:97, _create_env_file) 2025-04-03 16:57:11 [ 630 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2025-04-03 16:57:11 [ 630 ] DEBUG : No config file found (config.py:28, find_config_file) 2025-04-03 16:57:11 [ 630 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2025-04-03 16:57:11 [ 630 ] DEBUG : No config file found (config.py:28, find_config_file) 2025-04-03 16:57:11 [ 630 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 826 (connectionpool.py:547, _make_request) 2025-04-03 16:57:11 [ 630 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_certificate/_instances-2/.env --project-name roottestreloadcertificate --file /ClickHouse/tests/integration/test_reload_certificate/_instances-2/node/docker-compose.yml pull] (cluster.py:122, run_and_check) 2025-04-03 16:57:22 [ 630 ] DEBUG : Stderr: node Pulling (cluster.py:148, run_and_check) 2025-04-03 16:57:22 [ 630 ] DEBUG : Stderr: node Pulled (cluster.py:148, run_and_check) 2025-04-03 16:57:22 [ 630 ] DEBUG : ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_reload_certificate/_instances-2/.env --project-name roottestreloadcertificate --file /ClickHouse/tests/integration/test_reload_certificate/_instances-2/node/docker-compose.yml up -d --no-recreate') (cluster.py:3200, start) 2025-04-03 16:57:22 [ 630 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_certificate/_instances-2/.env --project-name roottestreloadcertificate --file /ClickHouse/tests/integration/test_reload_certificate/_instances-2/node/docker-compose.yml up -d --no-recreate] (cluster.py:122, run_and_check) 2025-04-03 16:57:22 [ 630 ] DEBUG : Stderr: Network roottestreloadcertificate_default Creating (cluster.py:148, run_and_check) 2025-04-03 16:57:22 [ 630 ] DEBUG : Stderr: Network roottestreloadcertificate_default Created (cluster.py:148, run_and_check) 2025-04-03 16:57:22 [ 630 ] DEBUG : Stderr: Container roottestreloadcertificate-node-1 Creating (cluster.py:148, run_and_check) 2025-04-03 16:57:22 [ 630 ] DEBUG : Stderr: Container roottestreloadcertificate-node-1 Created (cluster.py:148, run_and_check) 2025-04-03 16:57:22 [ 630 ] DEBUG : Stderr: Container roottestreloadcertificate-node-1 Starting (cluster.py:148, run_and_check) 2025-04-03 16:57:22 [ 630 ] DEBUG : Stderr: Container roottestreloadcertificate-node-1 Started (cluster.py:148, run_and_check) 2025-04-03 16:57:22 [ 630 ] DEBUG : ClickHouse instance created (cluster.py:3208, start) 2025-04-03 16:57:22 [ 630 ] DEBUG : get_instance_ip instance_name=node (cluster.py:2082, get_instance_ip) 2025-04-03 16:57:22 [ 630 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottestreloadcertificate-node-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 16:57:22 [ 630 ] DEBUG : get_instance_ip instance_name=node (cluster.py:2092, get_instance_global_ipv6) 2025-04-03 16:57:22 [ 630 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottestreloadcertificate-node-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 16:57:22 [ 630 ] DEBUG : Waiting for ClickHouse start in node, ip: 172.16.1.2... (cluster.py:3216, start) 2025-04-03 16:57:22 [ 630 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottestreloadcertificate-node-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 16:57:22 [ 630 ] DEBUG : http://localhost:None "GET /v1.46/containers/c15b98bb65f1d590b60ea997e094412e120c7cefa739f845ccb8f83a541c975d/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 16:57:23 [ 630 ] DEBUG : http://localhost:None "GET /v1.46/containers/c15b98bb65f1d590b60ea997e094412e120c7cefa739f845ccb8f83a541c975d/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 16:57:23 [ 630 ] DEBUG : http://localhost:None "GET /v1.46/containers/c15b98bb65f1d590b60ea997e094412e120c7cefa739f845ccb8f83a541c975d/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 16:57:23 [ 630 ] DEBUG : http://localhost:None "GET /v1.46/containers/c15b98bb65f1d590b60ea997e094412e120c7cefa739f845ccb8f83a541c975d/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 16:57:23 [ 630 ] DEBUG : http://localhost:None "GET /v1.46/containers/c15b98bb65f1d590b60ea997e094412e120c7cefa739f845ccb8f83a541c975d/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 16:57:23 [ 630 ] DEBUG : ClickHouse node started (cluster.py:3220, start) ------------------------------ Captured log call ------------------------------- 2025-04-03 16:57:23 [ 630 ] DEBUG : run container_id:roottestreloadcertificate-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cat > /etc/clickhouse-server/config.d/cert.xml << EOF\n\n 8443\n \n \n /etc/clickhouse-server/config.d/first.crt\n /etc/clickhouse-server/config.d/first.key\n true\n true\n sslv2,sslv3\n true\n \n \n \n\nEOF'] (cluster.py:2126, exec_in_container) 2025-04-03 16:57:23 [ 630 ] DEBUG : Command:[docker exec roottestreloadcertificate-node-1 bash -c cat > /etc/clickhouse-server/config.d/cert.xml << EOF 8443 /etc/clickhouse-server/config.d/first.crt /etc/clickhouse-server/config.d/first.key true true sslv2,sslv3 true EOF] (cluster.py:122, run_and_check) 2025-04-03 16:57:23 [ 630 ] DEBUG : Executing query SYSTEM RELOAD CONFIG on node (cluster.py:3677, query) 2025-04-03 16:57:23 [ 630 ] DEBUG : run container_id:roottestreloadcertificate-node-1 detach:False nothrow:False cmd: ['curl', '--silent', '--cacert', '/etc/clickhouse-server/config.d/first.crt', 'https://localhost:8443/'] (cluster.py:2126, exec_in_container) 2025-04-03 16:57:23 [ 630 ] DEBUG : Command:[docker exec roottestreloadcertificate-node-1 curl --silent --cacert /etc/clickhouse-server/config.d/first.crt https://localhost:8443/] (cluster.py:122, run_and_check) 2025-04-03 16:57:23 [ 630 ] DEBUG : Stdout:Ok. (cluster.py:146, run_and_check) 2025-04-03 16:57:23 [ 630 ] DEBUG : run container_id:roottestreloadcertificate-node-1 detach:False nothrow:False cmd: ['curl', '--silent', '--cacert', '/etc/clickhouse-server/config.d/WithChain.crt', 'https://localhost:8443/'] (cluster.py:2126, exec_in_container) 2025-04-03 16:57:23 [ 630 ] DEBUG : Command:[docker exec roottestreloadcertificate-node-1 curl --silent --cacert /etc/clickhouse-server/config.d/WithChain.crt https://localhost:8443/] (cluster.py:122, run_and_check) 2025-04-03 16:57:23 [ 630 ] DEBUG : Exitcode:60 (cluster.py:150, run_and_check) 2025-04-03 16:57:23 [ 630 ] DEBUG : run container_id:roottestreloadcertificate-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'cat > /etc/clickhouse-server/config.d/cert.xml << EOF\n\n 8443\n \n \n /etc/clickhouse-server/config.d/WithChain.crt\n /etc/clickhouse-server/config.d/WithChain.key\n true\n true\n sslv2,sslv3\n true\n \n \n \n\nEOF'] (cluster.py:2126, exec_in_container) 2025-04-03 16:57:23 [ 630 ] DEBUG : Command:[docker exec roottestreloadcertificate-node-1 bash -c cat > /etc/clickhouse-server/config.d/cert.xml << EOF 8443 /etc/clickhouse-server/config.d/WithChain.crt /etc/clickhouse-server/config.d/WithChain.key true true sslv2,sslv3 true EOF] (cluster.py:122, run_and_check) 2025-04-03 16:57:23 [ 630 ] DEBUG : Executing query SYSTEM RELOAD CONFIG on node (cluster.py:3677, query) 2025-04-03 16:57:23 [ 630 ] DEBUG : run container_id:roottestreloadcertificate-node-1 detach:False nothrow:False cmd: ['curl', '--silent', '--cacert', '/etc/clickhouse-server/config.d/WithChain.crt', 'https://localhost:8443/'] (cluster.py:2126, exec_in_container) 2025-04-03 16:57:23 [ 630 ] DEBUG : Command:[docker exec roottestreloadcertificate-node-1 curl --silent --cacert /etc/clickhouse-server/config.d/WithChain.crt https://localhost:8443/] (cluster.py:122, run_and_check) 2025-04-03 16:57:23 [ 630 ] DEBUG : Exitcode:60 (cluster.py:150, run_and_check) ---------------------------- Captured log teardown ----------------------------- 2025-04-03 16:57:24 [ 630 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_certificate/_instances-2/.env --project-name roottestreloadcertificate --file /ClickHouse/tests/integration/test_reload_certificate/_instances-2/node/docker-compose.yml stop --timeout 20] (cluster.py:122, run_and_check) 2025-04-03 16:57:27 [ 630 ] DEBUG : Stderr: Container roottestreloadcertificate-node-1 Stopping (cluster.py:148, run_and_check) 2025-04-03 16:57:27 [ 630 ] DEBUG : Stderr: Container roottestreloadcertificate-node-1 Stopped (cluster.py:148, run_and_check) 2025-04-03 16:57:27 [ 630 ] DEBUG : Command:[bash -c [ -f /ClickHouse/tests/integration/test_reload_certificate/_instances-2/node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_reload_certificate/_instances-2/node/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] (cluster.py:122, run_and_check) 2025-04-03 16:57:27 [ 630 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_reload_certificate/_instances-2/.env --project-name roottestreloadcertificate --file /ClickHouse/tests/integration/test_reload_certificate/_instances-2/node/docker-compose.yml down --volumes] (cluster.py:122, run_and_check) 2025-04-03 16:57:28 [ 630 ] DEBUG : Stderr: Container roottestreloadcertificate-node-1 Stopping (cluster.py:148, run_and_check) 2025-04-03 16:57:28 [ 630 ] DEBUG : Stderr: Container roottestreloadcertificate-node-1 Stopped (cluster.py:148, run_and_check) 2025-04-03 16:57:28 [ 630 ] DEBUG : Stderr: Container roottestreloadcertificate-node-1 Removing (cluster.py:148, run_and_check) 2025-04-03 16:57:28 [ 630 ] DEBUG : Stderr: Container roottestreloadcertificate-node-1 Removed (cluster.py:148, run_and_check) 2025-04-03 16:57:28 [ 630 ] DEBUG : Stderr: Network roottestreloadcertificate_default Removing (cluster.py:148, run_and_check) 2025-04-03 16:57:28 [ 630 ] DEBUG : Stderr: Network roottestreloadcertificate_default Removed (cluster.py:148, run_and_check) 2025-04-03 16:57:28 [ 630 ] DEBUG : Cleanup called (cluster.py:894, cleanup) 2025-04-03 16:57:28 [ 630 ] DEBUG : Docker networks for project roottestreloadcertificate are NETWORK ID NAME DRIVER SCOPE (cluster.py:873, print_all_docker_pieces) 2025-04-03 16:57:28 [ 630 ] DEBUG : Docker containers for project roottestreloadcertificate are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:881, print_all_docker_pieces) 2025-04-03 16:57:28 [ 630 ] DEBUG : Docker volumes for project roottestreloadcertificate are DRIVER VOLUME NAME (cluster.py:889, print_all_docker_pieces) 2025-04-03 16:57:28 [ 630 ] DEBUG : Command:[docker container list --all --filter name='^/roottestreloadcertificate-.*-1$' --format '{{.ID}}:{{.Names}}'] (cluster.py:122, run_and_check) 2025-04-03 16:57:28 [ 630 ] DEBUG : Unstopped containers: {} (cluster.py:908, cleanup) 2025-04-03 16:57:28 [ 630 ] DEBUG : No running containers for project: roottestreloadcertificate (cluster.py:922, cleanup) 2025-04-03 16:57:28 [ 630 ] DEBUG : Trying to prune unused networks... (cluster.py:928, cleanup) 2025-04-03 16:57:28 [ 630 ] DEBUG : Trying to prune unused images... (cluster.py:944, cleanup) 2025-04-03 16:57:28 [ 630 ] DEBUG : Command:[docker image prune -f] (cluster.py:122, run_and_check) 2025-04-03 16:57:28 [ 630 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:146, run_and_check) 2025-04-03 16:57:28 [ 630 ] DEBUG : Images pruned (cluster.py:947, cleanup) 2025-04-03 16:57:28 [ 630 ] DEBUG : Trying to prune unused volumes... (cluster.py:953, cleanup) 2025-04-03 16:57:28 [ 630 ] DEBUG : Command:[docker volume ls | wc -l] (cluster.py:122, run_and_check) 2025-04-03 16:57:28 [ 630 ] DEBUG : Stdout:1 (cluster.py:146, run_and_check) 2025-04-03 16:57:28 [ 630 ] DEBUG : Volumes pruned: 1 (cluster.py:958, cleanup) ============================== slowest durations =============================== 11.71s setup test_reload_certificate/test.py::test_chain_reload 4.11s teardown test_reload_certificate/test.py::test_chain_reload 0.60s call test_reload_certificate/test.py::test_chain_reload =========================== short test summary info ============================ FAILED test_reload_certificate/test.py::test_chain_reload - Exception: Comman... ============================== 1 failed in 16.67s ============================== Traceback (most recent call last): File "/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration/./runner", line 528, in subprocess.check_call(cmd, shell=True) File "/usr/lib/python3.10/subprocess.py", line 369, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command 'docker run --rm --name clickhouse_integration_tests_8u4b23 --privileged --dns-search='.' --memory=30709026816 --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=5dc43a6382f0 -e DOCKER_BASE_TAG=6712d5cc610d -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS=" -rfEps --run-id=2 --color=no --durations=0 test_reload_certificate/test.py::test_chain_reload -vvv" altinityinfra/integration-tests-runner:cd6390247eca ' returned non-zero exit status 1.